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AfiSIBACT 

To help assess the writing ability of college 
freshmen studying English as a second language (ESL) , this study vas 
undertaken to identify particular structures of subordination 
associated with vriting maturity and to develop a diagnostic 
instrument to test student control of those structures. Folloving 
sentence-generating principles of transformational grammar, the 
developed examination, entitled Test of Ability to Subordinate (TAS) , 
offers test items in the form of pairs or triads of kernel cr "core^ 
sentences vhich students are asked to combine into one sentence by 
filling in missing vords in a given sentence frame. The 50-item, 
limitod-response examination vas administered to a number of ESL 
colle^^e freshmen along vith the Kichigan Test of English Language 
Proficiency and a composition exercise. The TAS correlated .86 vith 
scores on the Michigan Test and .74 vith composition scores. The 
study suggests thats (1) certain structures of subordination appear 
to be critical elements of overall vriting ability; (2) it is 
possible to construct valid objective tests vhich ask students to 
actively engage in vriting sentences as veil as in a cognitive 
process required in free vriting; and (3) the ability to produce 
certain transformations through sentence combining is indicative ^f 
the ability to perform these transformations during the normal 
vriting process. {Author) 
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ASSESSING ^YRITING ABILITY OP ESL COLLEGE FRESHMEN 

by David M. Davidson 

College Instructors of English as a Second Language have 
come to recognize the need for more accurate and efficient methods 
of assessing writing ability of entering ESL students • This need 
has been prompted by the rising number of students with English as 
a seooi^d language attending college, the changing circumstances 
and demands of educational institutions, and the increased under- - 
standing of language acquisition and the components of writing 
ability fostered by recent research. 

The expansion of college-level ESL progra^ms throughout the 
coxintry attests to the. fact that the number of students whose 
native language is not English applying for admission to American 
colleges has increased significantly in recent years^ This increase 
has been due in part to the general increase in college attendance 
throughout the country and to the pre-recession expansion of 
facilities not only to meet the general need but to accommodate -4 
those with particular requirements, such as disadvantaged students. ;| 
Large numbers of immigrants and students on visa have been seeking ^ 
higher education in the United States. Native-born Americans with 
non-English language backgrounds are not only seeking admission to i| 
colleges but are being supported in their efforts by scholarships | 
and special programs. Open Admissions in the City University of i 
New York has encouraged many such students to ptirsue higher 1 
education* \.'\ 
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Although non-English speaking students entering college 
require training in all language skills, writing is of major 
importance at this level of education.^ With large classrooms 
and a less personalized approach to teaching, the student is 
* most often evaluated through written means such as research 
papers and essay examinations* And while success in college is 
highly dependent on a student's writing skJLlls, non-English 
speaking students show the least proficiency in this area.2 

Time is another important consideration in working with 
such students. Particularly in the community colleges, but else- 
where as well, most of these students have limited financial 
resources and cannot afford the luxury of an extended language 
program. Many are part-time students with full- or part-time 
Jobs, and others are attending school on limited scholarships or 
other forms of financial aid. Increasingly, more mature people 
with family obligations are attending college. The institution 
itself, faced with financial difficulty, has less money available 
for "special" and non-credit programs. The pressure on the in- 
structor from both student and institution is to have the student 
enter the academic mainstream as quickly as possible. The move 
towards instructor accoiintability is one result, with such ' 
methods as the implementation of competency-based objectives 
being employed. 

The need then is to train students as quickly and efficiently 
as possible in the vrriting skills necessary for successful college 
study. Recognition of criteria for acceptable college-level 
writing and proper placement of students would greatly assist the 
teacher in this effort. 
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Llteratiire concerned with the development of writing ability 
is virtually imaniaous in identifying the ability to subordinate 
as highly significant in mature writing. (Major studies in this 
area are cited in the bibliography.) As children grow, their 
command of syntactic structures increases, along with the in-^ 
creasing awareness of their environment and its demands. With 
this growth comes the ability to anticii)ate responses, make judg- 
ments about relationships, and understand and convey more specific 
meaning. Younger children rely heavily on coordination to convey 
their ideas, but as they grow they make greater use of structures 
of .subordination. This development is evidenced in children's 
writing; and a number of researchers have shown correlations be- 
tween the frequency of use of certain structures and the age of 
the writers. The "maturity" of adult writing has also been , 
assessed, with researchers drawing the conclusion that the "mat lire 
writer can be identified by his use of certain structures of sub- 
ordination in particular ways. 

This research suggests that a valid and reliable test of 
ability to subordinate In writing could be a valuable tool in 
helping a rising non-native speaking population within an in- 
creasing demanding college environment. 

Current tests of writing ability do not adequately serve 
diagnostic and placement needs. They are of two types: (l) the 
free composition, in which the student is asked to write a minimum 
number of words on a particular topic in a given time period with 
minimal guidance in terms of organization, structure, or vocabu- 
lary; and (2) the short answer examination, in which 'he student 
is asked, for example, to make choices for sentence completion or 
to detect non-standard usages. 



The free composition examination suffers from several defects 
In normal use, even for native speakers. Peraltting students to 
write freely allows them to use only those structures and lexicon 
they are familiar with and to avoid others. Such examinations 
are often graded on the basis of loosely defined criteria" with 
lack of consistency from one reader to another;^ and grading is 
time-consuming and often impractical in large numbers • Further- 
more, an unstructured examination of this type does not isolate 
specific writing problems but can only give a general view of 
the student's deficiencies. 

Not only is the free composition examination inadequate 
for native speakers, it is particularly unfair to non-native 
speakers, who often lack the fluency to write adequately under 
time pressure. Having to marshal ideas about a given topic and 
establish the organization and structure necessary to convey them 
requires considerably more time than normally allotted in this 
type of test.^ Faced with the normal writing demands of college 
courses — term papers and one-to-two-hour essay examinations on 
material previously read and discussed, many non-native speakers 
will do considerably better than their performance on a time- 
limited free composition would Indicate. 

The major weakness of short-answer examinations is that they 
require recognition of standard, non-English, and even non-standard 
usages without demanding production of the written word. Even 
if a student can recognize a non-Knglish or non-standard usage, 

5 

there is no measure of his ability to correctly substitute for It.-^ 



A ajajor improvement on both types of examinations — free 
composition and multiple choice — would be an instrument that: 

(1) measures discrete , significant grammatical elements of 
writing ability for diagnostic as well as placement purposes; 

(2) requires students to actively employ the language elements 
being tested for; (3) can be easily and consistoiitly graded; and 
(4) allows sufficient tif??e for respondents to indicate their 
ability* 

I undertook to develop such an instrument for the testing 
and placement of college-level non-native speakers of English 
on-the basis -of writing ability as determined by their ::ontrol of 
significant structures of subordination. 

In order to identify the structures of subordination moGt 
indicative of acceptable college-level writing, I surveyed recent 
issued of Joxxrnals devoted to the teaching or study of the English 
language, books and manuals on the theory and practice of English 
language instruction, instructional materials designed for native 
as well as non-native students, and relevant unpublished disser- 
tations. From this literature I identified the following struc- 
t.ures as important Indicators of writing maturity: 

1. prenominal adjectives; 

2. adverbs; 

3. prepositional phrases, particularly of time and masrir^er;; 

4. adverbial clau?^es, particularly when used before the main 
clause, with clauses of cause and condition more sophisticated 
than those of time and place; 

5. relative clauses, especially as non-restrictive subject 
modifiers embedded in the main clause; 



6. noun clauses, particularly in positions other than direct 
objects, although their use as subjects is rare even among high 
school students; 

7. participial phrases; 

8. gerund phrases; 

9. infinitive phrases; 

10. absolute phrases, although rarely used even by twelfth 
graders; 

11. appositive constructions, a] so rarely used. 

After identifying these structures, I surveyed forty recently 
published textbooks for college students geared primarily or 
entirely to the writing process. (See appended list.) (According 
to J. F. Green, "Composition textbooks for college freshmen are a 
reasonable guide to those features of expository writing accepted 
as important by educated native speakers." 6) In addition, I 
randomly selected one hundred expository compositions written by 
entering freshmen — all native speakers of English — at my own 
institution, Bronx Community College. Each composition was on 
the same topic and was rated as "college level" by at least two 
English Department instructors. These compositions were analyzed 
for frequency of use of the various structures of subordination 
for practical determination of which structures are found most 
commonly in college-level expository writing. 

Selection of Structures for Testing 

Literature indicating the importance of ability to use 
prenominal adjectives was supported by my survey of the texts and 
analysis of the writing samples. The texts stressed use of 
descriptive adjectives, both alone and in combination; and they 
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were the most widely used of the structures examined in the 
writing samples. Possessive adjectives, cited in eight of the 
texts, were used by a majority of the student writers. 

Both the texts and the writing samples showed the importance 
of adverbs, particularly of degree, time, and manner. 

Prepositipnal phrases were used by all the students and cited 
by more than two-thirds of the texts. Regarded as most significant 
were their use as adverbs of place, time, and manner; as descrip- 
tive and locative adjectives; and as verb objects. 

More of t':e texts treated adverbial clauses thaii any other 
structure under consideration, with emphasis on clauses of time, 
condition, and cause. Student writing reflected this emphasis. 

Adjective clauses were covered by 30 books and used by 84 
of the students. 

Noun clauses as verb objects were discussed by more than 
half the texts and found in more than 70% of the writing samples.^ 

Participial phrases were covered in 32 of the texts and used 
by 56 students, primarily adjectivally. 

Half the texts treated gerund phrases, primarily as objects 
of prepositions and verbs. Use of the former was noted in 40^ 
of the writing samples. 

Infinitive phrases functioning as verb objects, adverbs, and 
adjectives were noted in the texts and substantially represented 
in the writing samples. 

Two of the main categories of structures died in the 
literature — absolute and appoaitive phrases-- were the least cited 
in the texts and were hardly used by the native-born freshmen 

Q 
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All of the other structures cited in the literature were 
incorporated into the developed test, entitled Test of Ability to 
Subordinate (TAS), Particular forms to be used were determined 
by a combination of frequency of text citation, actual use in the 
writing saaples, and adaptability to the test format • 

The structures incorporated into the test were: 

1. Prenominal Adjectives 

a. descriptive adjectives 

b. possessive adjectives 
c* possessive nouns 

d, two-word combinations 

(1) possessive adjective-descriptive 

(2) descriptive-descriptive 

'2. Adverbs 

a. manner 

b. degree 

c. time and frequency 

3. Prepositional Phrases 

a, adverbial — place 

b, adverbial — manner 
c • adverbial — time 

d. adjectival — genitive 

e. verb object 

4. Relative clauses 

5. Noun Clauses (verb object) 

6. Adverbial Clauses 
a, time 

b* condition 
c* cause 

7. Participial Phrases (adjectival) 

'8, Gerund Phrases (object of preposition) 

9* Infinitive Phrases 

a, verb object 

b, adverbial 
c* adjectival 



TABLE 1 

STRUCTURES OF SUBORDINATION IN SURVEYED 
TEXTS AND l^RITING SAMPLES 



Structxire No. of Texts No. of Instances 

Cited in Writing of Use in 

Samp les Writing 

Used in Samples 



Prenominal Adjectives 
Descriptive 
Possessive Adjectives 
Possessive Nouns 
2 -word Combinations 

Aiverbs ^ - 

Manner 

Time, Frequency 
Degree 

Prepositional Phrases 
Adverbial -Place 
Adve rb ia 1 - Time 
Adverb ial -Manner 
Modifying Adjective 
Ad j e c t ival - De s cr ip t i ve , 

Genitive 
Adjectival-Place 
Object of Verb 

Adjective Clauses 

Noun Clauses 
Object of Verb 
Subject 

Adverbial Clauses 
Time 

Condition 

Cause 

Contrast 

Participial Phrases 
Adjectival 
Adverbial 







1 JiL J 


28 


100 


955 


8 


76 


148 


7 


44 


52 


12 


40 


56 


24 


OA 




23 


34 


54 


12 


49 


70 




DO 




97 


lUU 








OA 


13 


40 


44 


11 


52 


11 


A 




Q D 
JO 


16 




J. / J. 


10 


64 


i09 


10 


40 


58 


30 


84 


218 


23 


82 


207 


21 


72 


146 


12 


9 


9 


37 


85 


186 


34 


33 


39 


27 


35 


52 


25 


23 


31 


16 


10 


15 


32 


56 


96 


26 


43 


50 


13 


17 


17 
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TABLE 1 — Continued 





Cited 


in 


No nf 

Writing 
Samples 
Used in 


Tti ct"iinr*t* q 

of Use in 

Writing 

Samples 


Gerund Phrases 

Object of Preposition 


- 20 
15 

13 




58 

11 

40 


97 

11 

72 


Infinitive Phrases 
Object of Verb 
Adverbial 
Adjectival 


24 
14 
12 
8 




98 
68 
69 
57 


417 
127 
166 

' 86 


Absolute Phrases 


1.1 




2 


2 


Appositive Phrases 


12 




5 


6 
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Test Foraat 

The test items were written in a sentence-combining format 
following the sentence-generating principles of transformational 
grammar • Students were required to take two or three "core" 
sentences (for purposes of clarity, in some cases sentences more 
elaborate than "kernel" sentences were used) and combine them into 
one sentence within a given frame which required formulation of 
a particular structure of subordination. Core sentences were 
designed to test students* ability to perform a variety of trans- 
formational procedures in the production of the desired structures. 
(See table 2. ) 

Several factors were considered in determining the number of 
items to be included in the test. Since the examination was 
intended primarily for diagnostic purpos-ea, a sufficient number 
of items were necessary to determine students* command of the 
structures being tested. 

For several reasons, tixe was an important consideration. 
For use as a placement test, either centrally to large groups of 
students or in a classroom during a regular cleas session, the 
examination, including administration time, could take no more 
tnan an hour to be practical. Since this was designed as a power 
test, there could be no more items than could be comfortably 
handled by almost all of the students in that time. The fact 
that this was a completion test, involving actual writing rather 
than multiple choice selection, limited the number of items that 
could be used. 

Extensive pretesting with students of widely varying language 
abilities showed that 50 items could be completed by more than 9Q% 
of the students within 50 minutes. It was aiVo'felt that the nine 
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TABLE 2 
EXAMPLES OF TEST ITEMS 



Prenominal adjective from noun phrase, 

a. The doctor looked at the leg. b. The leg had an 

infection . _ * 

The doctor looked at the infected leg. 

Prenominal adjective from prepositional phrase. 

a. They rented a boat. b. The boat was for fishing. 

They rented a fishing boat. ■ " . ^ 

Advarb from adjective. 

a. They were satisfied, b. Their satisfaction was 
. complete . ..^ 

They were completely satisfied. 

Genitive prepositional phrase from possessive statement. 
J; The patient has a condition, b. His condition is poor. 
The condition ot the patient Ts poor. 

Adverbial clause of time from full subject-predicate 
structure. - r 

Su The telephone rang. b. They were watching telpvision , 
The telephone rang while they were watching television . " 

Adverbial clause of cause from subject-predicate structure 
a. He does not smoke, b. Smoking makes him sick. 
He does not smoke because smoking makes~TrinrsTcIc . 

Relative clause from subject-predicate construction, 
a. This IS the building, b. It burned d own last week. 
This r.s the building that/which" burned do'wn last week . " 

Noun clause from statement. 

a. They were sorry , b. They said so. 

They said ( that) they were sorry . 

Noun clause from , yes-no ques-tion. '.. 

a. Did the train arrive ? b. We don't know. 
We don t know if the train arrived . 

Noun clause from information question. 

f.' Why is he always complaining? b. We do not understand. 
We do not understand why he is always complaining 
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TABLE 2 --Continued 



P -^icxpxal phrase ( ing form) from predicate structure. 

we have a map. b. The m,^n clearly shows this street 
# have a map clearly showi this street " 

Participial phrase (ed forai) from predicate structure, 
a. John was only injured slightly , b. John did not 

have to go to the hospital. 
P^^y. injured slightly . John did not have to go to the 
hospital. 

13. Gerund phrase from subject-predicate construction. 

a- We will s ee them soon , b. We look forward to that. 
We look forward to seeing them soon . 

14. Infinitive phrase (adverbial) from subject-predicate 
construction. 

a. We understand English , b. It is easy for us. 
It is easy for us to understand English . 

15. Infinitive phrase (adjectival) from subject-predicate 
construction. 

^' They do not live with their mother , b. It was their 
decision. 

It was their decision not to live with their mother . 

16. Infinitive phrase (verb object) from subject-predicate 
construction. 

a- She bought a new car , b. Her sister persuaded her. 
Her sister persuaded her to buy a new car. 
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structures could adequately be tested with this number of iteas, 
allotting five or six to each structure. 

Qraaaat ical ' Lexical Control 

T<8? limit the cause of students' errors to inability to 
handle the tested structures, gramoiatical and lexical content 
were controlled. Only three irregular verbs requiring manipu- 
lation were used in the examination: took to taken, came to to 
come, and bought to to buy . Three of the infinitives require no 
change of verb form — merely addition of to — while one item re- 
quires a change from the third person singular form. 

Of the eight ing forms required in the participial and 
gerund constructions, four require change from the base form 
(presented as third person plural, future, and infinitive), and 
two require change from the third person singular. Only one 
requires change from the past tense* 

One change is necessary from subject to object personal " 
pronoun and one from subject to possessive pronoun. One noun 
must be changed to a participial adjective. 

Pretest results indicated that these changes were within 
the ability of students classed as "low intermediate" and above • 

Two hundred and ten different words were used in the 50 test 

items, counting irregular forms of verbs as separate words. All 

appear on the Thorndike-Lorge list of 30,000 most frequently used 
7 

words,' withjl64, or 78^, appearing among the 1,000 most commonly 
used words and an additional 25, or 12%, with a high frequency of 
usage of 50 per million. Many of the remaining 21 words would be 
easily recognized by college students (e.g*, bus, television , 
Spanish , football), ^ r 
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Teat Results 

The Test of Ability to Subordinate was administered to 148 
non-native speakers and 153 native speakers to determine overall 
test reliability, Information about the component Items and 
^*.ructures, the diagnostic and screening values of the exaailna- 
Ion, and concurrent validity. The mean score for ESL sturi^nts 
was 25.7- The median was 28; the range, 1-45; and the standard 
deviation 13-0. Native speakers had a range of 39-50, a mean 
of 45.3, a median of 46, and a standard deviation of 2.9. 

The Kuder-Rlcl5Lardson Formula 20 was applied to the test 
regult3 to determine the reliability of the examination, and 
the reliability coefficient for the TAS was computed at .95. 
This Is regarded as representing a satisfactory level of reliability 
for a test with both diagnostic and placement functions. 

The standard error of measurement of the TAS was computed 
at 2.9- 

Analysis of Error s 

A large percentage of errors on this test defy analysis 
because, the examinees were free to write anything they thought 
appropriate. In many cases they merely repeated one of the origi- 
nal sentences, randomly selected one or two words from the 
sentences, or Introduced Irrelevant words. Indicating that th:. 
students were Incapable of handling the structures being tested. 
However, for most of the Items, more than half of the responses 
were subject to analysis which Indicated eight basic categories of 
difficulties: (1) omission of words and structures, (2) Incorrect word 
forms and structures, (3) Incorrect choice of words, (4) failure to 
delete or substitute, (5) use of Inappropriate structures, (6) Incor- 
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rect tense, (7) incorrect sequence of words, and (S) errors 
that demonstrate misunderstanding of the original sentences. 

The most common error fourid among all nine structures 
was omission of words and complete structures. This error 
was noted anioi.g the adjective items, particularly those calling 
for two adjectives, and among the adverbs. On every preposi- 
tional phrase item, prepositions were omitted by a substantial 
number of examinees, indicating a lack of understanding of 
the preposition's functions especially in relation to the 

verb. A common error among the relative clause items was ^ 

omission of the relative pronoun, an indication that many of 
the students did not have a grasp of that clause structure. 
Similar problems were seen in the noun and adverbial clauses 
where introductory and subordinate conjunctions as well as 
entire clauses were omitted, A problem similar to the one 
seen among the prepositional phrase items was found among the 
gerund questions where obligatory prepositions were omitted. 

Incorrect word forms were used in the descriptive 
adjective items as well as with those adverbs requiring the. 
Ij; suffix. Use of the present and past tenses rather than 
the past participle, and other errors showing no grasp of the 
participial form, were also noted. Another common error was 
use of the infinitive in place of the gerund form; and there 
were other errors showing inability to handle both infinitive 
and gerund phrases . 
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Incorrect word choices were made with prepositions 
introducing prepositional phrases and with subordinating 
conjunctions. Failure to delete or substitute words was 
noted primarily in the relative clause items where objects 
were not deleted and the relative pronoxm not substituted 
for the original subject.. 

Structures were regarded as inappropriate if they 
involved coordination rather than subordination (found in 
prepositional phrase, relative clause, and gerund items) or 
if they changed meaning. 

Tense problems were found in the noun clause construc- 
tions, particularly where sequence of tenses was required, and in 
a relative clause item. 

Incorrect sequence of words was found in .an item 
requiring two descriptive adjectives as well as in an item . 
testing an adverb of manner. 

Several items showed misunderstanding of the original 
sentences. 

One major distinction to be made in terms of the 
errors is whether or not the student has some grasp of the 
transformational process involved. A student, for example, 
who responded toan Item which calls for a relative clause 
([ that /who] we like) with that we like him may be demon- 
strating a more sophisticated understanding of this subordin- 
ating transformation (even though he failed to eliminate the 

18 
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object pronoun) than the student who responded with a coordinating 
structure which might be grammatically ^•more correct. 

With certain structures such as prenomlnal adjectives, the 
Instructor would have to examine each Incorrect response to see If 
i the problem Is the fallixre to make the required shift (e.g. to 
prenomlnal adjective position) or failure to make the correct 
change In word form (e.g. Infection to Infected). 

Structure Difficulty 

The difficulty of each of the structures was determined by 
finding the mean percent correct of the Items for each structure. 
(See table 3.) Results tended to follow what would have been 
expected on the basis of the research, analysis of the writing 
samples, and survey of the texts. The n;ore commonly used struc- 
tures In the writing samples — adjectives, adverbs, and prepositional 
and Infinitive phrases — were easier for the students than the noun 
and relative clAuses* Adverbial clauses, which were used less 
frequently in the writing samples but were the most common struc- 
tures found in the surveyed texts, were among the easier items, 
giving students less difficulty than the other two types of clauses. 
The less frequently used structures, participial and gerund phrases, 
were the most difficult. 

The degree of difficulty in handling these structures would 
seem to reflect their frequency of use in writing at this level, 
the emphasis placed on them by educators, and the students* 
sophistication of language usage associated with more complex 
transformational processes. 

19 
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TABLE 3 



MEAN PERCENT CORRECT FOR EACH OF THE 
NINE STRUCTURES OF SUBORDINATION 



Structure Percent 



Prepositional Phrase 


63 


.6 


Prenominal Adjective 


59 


.1 


Infinitive Phrase 


57, 


.8 


Adverbial Clause 


57 


.8 


Adverb 


55. 


,4 


Noun Clause 


48, 


.6 


Relative Clause 


46, 


.2 


Participial Phrase 


38, 


.0 


Gerund Phrase 


31. 


,8 
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Diagnostic Function 

The Test of Ability to Subordinate was designed primarily 
as a diagnostic tool. In Interpreting results, ^n x^egar"^ a 

student who correctly an. ^ ed at least Q0% of the , Items of a 
particular structure es proficient In the use of that structure • 
A student, therefore, who correctly answered at least 5 of 6 Items 
(of the adjectives, adverbs, relative clauses, adverbial clauses, 
and Infinitive phrases) and at least 4 of 5 Items (of the prepo- 
sitional, participial, and gerund phrases and the noun clauses) 
may be assumed to have mastery of those structures, although In 
some cases a review of particular forms might be In order. 

A student who correctly answered two, one, or none of the 
Items would need to be taught the use of that structure while 
correct answers for three, four, or five Items might Indicate 
the need for review, depending cn the number of Items te&ted for 
that structure and the particular transformations Involved* 

Individual test results Indicated that the test has discrim- 
inatory value among the nine structures. Mastery of a particular 
structure (the prepositional phrase) was demonstrated by a student 
at the l6th percentile, while mastery of the most difficult 
structure in the test, the gerund phrase, was found at the 50th 
percentile and above. No student had mastery of all nine struc- 
tures; mastery of eight was demonstrated at the 89th percentile 
and above, and students with mastery of at least five structures 
were found at the 54th percentile and above. , 
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Concurrent Validity 

To deteraiine concurrent validity of the Test of Ability to 
Subordinate . E3L students who took the TAS were also given the 
Michigan Test and an expository writing exercise, and results were 
correlatisd. 

A Pearson product oioment correlation coefficient was cal- 
culated between scores for the TAS and the Michigan Test for the 
148 students who took both examinations* The coiefflclent was .36. 
This confjparlson was made because the Michigan Test Is one of the 
most widely used commercially available screening devices for 
non-native speakers ^ Is used for placement purposes at several 
units of City University, and has been recommended as a University- 
wide placement Instrument, The test consists of 40 grammar Itcias, 
40 vocabulary Items, and 20 reading comprehension questions. A 
direct overlap between the two tests would occur from the similar 
skills being tested In the grammar section. Beyond that, John 
Carroll notes that both the grammar and x^eadlng subtests tend to 
measure general Intellectual ability along with English pro- 

g 

flclency. Both the grammar overlap and the "general ability" 
measurement Inherent In both tests would account for the high 
correlation between the two. This correlation Is comparable to 
one computed between the Michigan Test and the TOEFL reported at 
•89,^ further Indicating the validity of the TAS, 

To obtain reliable. scores on the writing samples, I employed 
Dr, Fred I, Godshalk and Dr. Robert Jones of the Educational 
Testing Service to conduct a rating session In which seven college 
Instructors of English as a Second Language scored the 148 compo- 
sitions that were written. The "holistic" rating method developed 
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by Dr# Godshalk involves extensive orientation by the "Chief 
Reader" (in this case. Dr. Godshalk himself) in which a number 
of sample compositions taken froa the group to be rated are read 
and scored by all the readers. Discussion ensues in which 
reasons for the various ratings are given and readers have the 
opportunity to see how .their Judgments compare to those of their 
co-readers. During the actual readings, "Table Leaders" spot 
check the ratings of those at their tables, telling readers when 
their Judgments diverge from those of the leaders and other readers. 
The Chief Reader also spot checks and from time to time introduces 
new samples for further group evaluation and discussion. The method 
tends to bring about uniform Judgments among readers and through 
twenty years of use has proven to be an effective method for 
achieving acceptable inter-reader reliability.^^ 

All of the compositions not used as samples were rated 
individually by three readers. There was a high degree of 
rater agreement, with 19% of the papers having three identical 
scores and another S\% showing a one-point difference, indicating 
virtual agreement on 80j5 of the compositions. 

A Pearson product moment correlation of .74 was determined 
between the scores on the 148 compositions and the TAS, and a 
coefficient of .69 was found between the composition, and Michigan 
Test scores. The .74 correlation indicates that the TAS does 
measure significant components of "writing ajbility. " In this 
regard, it is comparable to the Michigan Test and to reports-d 
correlation':^ between the TOEFL and compositions (.74 for the 
Writing Ability subtest and .78 for the entire test).ll 
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Conclusion 

The favorable results of the developed examination, in terms 
of its correlation with writing ability and its relative ease of 
administration and reliability of grading, indicates the feasi- 
• bility of constructing valid objective tests which ask students 
to actively engage in writing sentences as well as in a cognitive 
process required in free writing. Similar examinations testing 
other elements of the composing process, along with the TAS, could 
serve not only as a good predictor of writing ability but as a 
diagnostic instrument for practical use by instructors. 

Further, the results of the Test of Ability to Subordinate 
and Its moderately high correlation with actual writing indicate 
that the, nine structxires of subordination identified in the study 
are indeed critical elements of overall writing ability. That the 
degree of difficulty encountered by the students in handling these 
structures seems to vary according to the structures' general 

i 

frequency of use suggests several things. Ability to use certain 
structures may be dependent on the amount of contact one has with 
them in the language; t'lis contact is both receptive-r-hearing the 
language spoken and reading it — and active, as one uses the 
structures in speaking and writing* There may also be a natural 
sequence of development of use of these structures for the 
second language learner as there appears to be for the native 
speaker. It would follow that teaching strategies might take 
into account such ^a sequence. 

Recognition of the importance of these structures is par- 
ticularly vital for the college instructor charged with the task 
of helping students develop writing skills to a level which will 
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enable them to take full advantage of higher education, perform 
those necessary writing functions associated with many professions 
and trades, and explore a more sophisticated means of self-expression* 
The successful use of sentence combining in the TAS — that the 
i technique can be used in test situations without cumbersome in- 
structions to bring about production of desired structures—suggests 
that this technique may have a wider role in testing. It Is also 
further evidence that production of certain transformations 
through sentence combining is indicative of the ability to perform 
these transformations during the normal writing process. 

The implication for the ESL teacher (and for tHe instructor 
of native speakers who have not fully developed the ability to 
use certain transformations in writing) is to set about developing 
the transformational skills of students as a parallel to the ability 
that develops as native speakers learn to write in their own 
language. 
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